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AMENDMENTS TO THE CLAIMS 

This listing of claims replaces all prior versions, and listings, of claims in the application: 
Listing of Claims: 

1 . (Ciuxently Amended) In a computer system that includes software under test, a 
method of verifying the software with one or more tunable test cases that are capable of being set 
to any of a plurality of verification levels, the method comprising acts of: 

reading in one or more test cases that include a plurality of software testing 
instructions organized as a plurality of verification levels within a verification hierarchy, 
wherein at least two verification levels within the verification hierarchy define different 
amounts of checking to perform for determining if the software fimctions as intended 
when executed; 

reading in verification settings that define one or more desired verification levels 
within the verification hierarchy; 

identifying a test group comprising a plurality of test cases including at least one 
of the one or more test cases having p ortion of the pluraUty of software testing 
instructions within th e on e or mor e t e st oas e s t hat corresponds to the one or more desired 
verification levels; aad 

running a test on the software with all of the plurahty of test cases within the test 
group bv r unning the software testing instructions p ortion of th e on e or mor e t e st cas e s 
that correspond s corresponding to the one or more desired verification levels of each of 
the test cases in the test group; 

upon detecting an adverse or unexpected result from running the test, isolating the 
pluralitv of test cases within the test group and running each of the isolated test cases 
individually; and 

upon running each of the isolated test cases individually, determining which of 
the isolated test cases caused the adverse or unexpected result . 
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2. (Original) The method of claim 1, wherein a first test case fi"om the one or more 
test cases is part of a first test group, the first test group including one or more software testing 
instructions organized as one or more verification levels within the verification hierarchy, and 
wherein the verification settings that define the one or more desired verification levels for the 
one or more test cases also define one or more desired verification levels for the first test group. 

3. (Original) The method of claim 2, fiuther comprising acts of: 

identifying a portion of the one or more software testing instructions within the first test 
group that corresponds to the one or more desired verification levels; and 

rurming a portion of the first test group that corresponds to the one or more desired 
verification levels. 

4. (Original) The method of claim 3, wherein the verification settings define a single 
desired verification level for the first test case and the first test group. 

5. (Original) The method of claim 3, wherein the verification settings define a 
desired verification level for the first test case that is different firom a desired verification level 
for the first test group. 

6. (Original) The method of claim 4, wherein a second test case from the one or 
more test cases is part of the first test group, and wherein the verification settings define a 
desired verification level for the second test czise different firom the desired verification level for 
the first test group. 

7. (Original) The method of claim 5, wherein a second test case from the one or 
more test cases is part of the first test group, and wherein the verification settings define a 
desired verification level for the second test case that is different from the desired verification 
level for the first test group. 
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8. (Original) The method of claim 7, wherein verification settings define a desired 
verification level for the second test case that is different &om the desired verification level for 
the first test case. 

9. (Original) The method of claim 3, wherein a second test case from the one or 
more test cases is part of the first test group, and wherein third and fourth test cases firom the one 
or more test cases are part of a second test group, the second test group including one or more 
software testing instructions organized as one or more verification levels within the verification 
hierarchy, and wherein the verification settings that define the one or more desired verification 
levels for the one or more test cases also define one or more desired verification levels for the 
second test group, the method further comprising acts of: 

identifying a portion of the one or more software testing instructions within the second 
test group that corresponds to the one or more desired verification levels; and 

running a portion of the second test group that corresponds to the one or more desired 
verification levels. 

10. (Original) The method of claim 9, wherein the verification settings define 
different desired verification levels for each of the first test case, the second test case, the third 
test case, the fourth test case, the first test group and the second test group. 

11. (Original) The method of claim 10, wherein the first and second test groups are 
part of a third test group, the third test group including one or more software testing instructions 
organized as one or more verification levels within the verification hierarchy, and wherein the 
verification settings that define the one or more desired verification levels for the one or more 
test cases also define one or more desired verification levels for the third test group, the method 
further comprising acts of: 

identifying a portion of the one or more software testing instructions within the third test 
group that corresponds to the one or more desired verification levels; and 
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running a portion of the third test group that corresponds to the one or more desired 
verification levels. 

12. (Original) The method of claim 11, wherein the verification settings define a 
desired verification level for the third test group different fi-om each of the first test case, the 
second test case, the third test case, the fourth test case, the first test group and the second test 
group. 

13. (Original) The method of claim 1, wherein at least a portion of at least one of the 
plurality of software instructions determines that software information is available and uses the 
information for troubleshooting the software if it is determined that the software does not 
fimction as intended when executed. 

14. (Original) The method of claim 13, wherein the software information available is 
debug information. 

15. (Original) The method of claim 1, wherein the portion of the one or more test 
cases that corresponds to the one or more desired verification levels does not produce any testing 
output. 

16. (Original) The method of claim 1, wherein the portion of the one or more test 
cases that corresponds to the one or more desired verification levels produces one or more test 
outputs for verifying the software. 
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17. (Currently Amended) In a computer system that includes software under test, a 
method of verifying the software with one or more tunable test cases that are capable of being set 
to any of a plurality of verification levels, the method comprising steps for: 

loading one or more test cases that include a plurality of software testing 
instructions organized as a plurality of verification levels within a verification hierarchy, 
wherein at least two verification levels within the verification hierarchy define different 
amounts of testing to perform for determining if the software fiinctions as intended when 
executed; 

receiving verification setting instructions for one or more desired verification 
levels fi-om within the verification hierarchy for use in testing the softwar e, wherein the 
received verification setting instructions select the one or more desired verification levels 
firom a group of verification levels that include at least first and second verification 
levels, wherein selection of the first verification level causes the one or more test cases to 
be run during testing without producing any recorded output, and wherein selection of the 
second verification level causes the one or more test cases to be run during testing with 
recorded output : and 

testing the software at the one or more desired verification level s, which include 
at least one of the first and second verification levels, by running the one or more test 
cases that include the plurality of software testing instructions that correspond to the one 
or more desired verification levels. 
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1 8. (Original) The method of claim 1 7, wherein a first test case fi-om the one or more 
test cases is part of a first test group, the first test group including one or more software testing 
instructions organized as one or more verification levels within the verification hierarchy, and 
wherein the verification setting instructions for the one or more desired verification levels define 
a desired verification level for the first test case different from a desired verification level for the 
first test group, further comprising acts of: 

identifying a portion of the one or more software testing instructions within the 
first test group that corresponds to the one or more desired verification levels; and 

running a portion of the first test group that corresponds to the one or more 
desired verification levels. 

19. (Original) The method of claim 18, wherein a second test case from the one or 
more test cases is part of the first test group, and wherein the verification setting instructions 
define a desired verification level for the second test case that is different fi-om a desired 
verification level for tiie first test group. 

20. (Original) The method of claim 19, wherein verification setting instructions for 
the desired verification levels define a single verification level for the first and second test cases. 
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2 1 . (Currently Amended) In a computer Gyst e m that includ e s softwar e vmder t e st, a A 
computer program product comprising one or more computer readable storage m edia carrying 
storing c omputer executable instructions tha t, when executed, implemen t the method recited in 
claim 1. 

a method of verifying th e software with on e or mor e tunable t e st cases that are capabl e 
of being set to any of a plurality of verification levels, the method comprising acts of: 

r e ading in one or more test cases that includes a plurality of software - t e sting instruction s 
organized as a plurality of v e rification levels within a verification hi e rarchy, wherein at least two 
verification l e vels within th e verification hierarchy define different amounts of testing to perform 
for det e rmining if the software fimctions as int e nd e d when e xecuted; 

r e ading in verification settings that d e fin e a d e sired verification level within th e 
verification hierarchy; 

identifying a portion of th e plurality of softwar e t e sting instructions within th e on e or 
mor e test cas e s that corresponds to the d e sired v e rification level; and 

running the portion of the on e or mor e test cas e s that corr e sponds to th e d e sir e d 
verification l e vel. 

22. (Original) The computer program product of claim 21, wherein a first test case 
from the one or more test cases is part of a first test group, the first test group including one or 
more software testing instructions organized as one or more verification levels within the 
verification hierarchy, and wherein the verification settings that define the one or more desired 
verification levels for the one or more test cases also define one or more desired verification 
levels for the first test group. 

23. (Original) The computer program product of claim 22, wherein the verification 
settings define a single desired verification level for the first test case and the first test group, and 
wherein a second test case from the one or more test cases is part of the first test group, and 
wherein the verification settings define a desired verification level for the second test case 
different from a desired verification level for the first test group. 
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24. (Original) The computer program product of claim 22, wherein a second test case 
from the one or more test cases is part of the first test group, and wherein third and fourth test 
cases from the one or more test cases are part of a second test group, the second test group 
including one or more software testing instructions organized as one or more verification levels 
within the verification hierarchy, and wherein the verification settings that define the one or 
more desired verification levels for the one or more test cases also define one or more desired 
verification levels for the second test group, and wherein the verification settings define different 
desired verification levels for each of the first test case, the second test case, the third test case, 
the fourth test case, the first test group and the second test group. 
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25. (Ciirrently Amended) In a computer system that includes softwar e under t e st, aA 
computer program product comprising one or more computer readable storage m edia carrying 
storing c omputer executable instructions tha t, when executed, implement the method recited in 
claim 17. 

a method of verifying the software with one or more tunable t e st cases that are capable of 
being set to any of a plurality of verification lev e ls, the method compriGing steps for: 

loading one or more test cases that includ e a plurality of software testing instructions 
organized as a plurality of verification levels within a verification hierarchy, wh e rein at least two 
verification levels within the verification hierarchy d e fine different amounts of checldng to 
perform for determining if the software fimctions as int e nd e d wh e n ex e cuted; 

receiving verification setting instructions for one or more desir e d v e rification levels fi-om 
within the verification hierarchy for use in testing the softwar e ; and 

t e sting th e softwar e at th e on e or more desir e d v e rification l e v e ls by running th e one or 
more test cases that include the plurality of software testing instructions that correspond to th e 
on e or more d e sired verification levels. 

26. (Original) The computer program product of claim 25, wherein a first test case 
from the one or more test cases is part of a first test group, the first test group including one or 
more software testing instructions organized as one or more verification levels within the 
verification hierarchy, and wherein the verification setting instructions for the one or more 
desired verification levels define one or more desired verification levels for both the first test 
case and the first test group. 

27. (Original) The computer program product of claim 26, fiirther comprising acts of: 
identifying a portion of the one or more software testing instructions within the first test 

group that corresponds to the one or more desired verification levels; and 

running a portion of the first test group that corresponds to the one or more desired 
verification levels. 
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28. (Original) The computer program product of claim 27, wherein the verification 
setting instructions define a single desired verification level for the first test case and the first test 
group. 

29. (Original) The computer program product of claim 27, wherein the verification 
setting instructions define a desired verification level for the first test case that is different firom a 
desired verification level for the first test group. 

30. (Original) The computer program product of claim 28, wherein a second test case 
from the one or more test cases is part of the first test group, and wherein the verification setting 
instructions define a desired verification level for the second test case that is different fi-om the 
desired verification level for the first test group. 

3 1 . (Original) The computer program product of claim 29, wherein a second test case 
fi-om the one or more test cases is part of the first test group, and wherein the verification setting 
instructions define a desired verification level for the second test case that is different from the 
desired verification level for the first test group. 

32. (Original) The computer program product of claim 31, wherein verification 
setting instructions define a desired verification level for the second test case that is different 
from the desired verification level for the first test case. 
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33. (Original) The computer program product of claim 27, wherein a second test case 
from the one or more test cases is part of the first test group, and wherein third and fourth test 
cases from the one or more test cases are part of a second test group, the second test group 
including one or more software testing instructions organized as one or more verification levels 
within the verification hierarchy, and wherein the verification setting instructions that define the 
one or more desired verification levels for the one or more test cases also define one or more 
desired verification levels for the second test group, the method fiuther comprising acts of: 

identifying a portion of the one or more software testing instructions within the 
second test group that corresponds to the one or more desired verification levels; and 

running a portion of the second test group that corresponds to the one or more 
desired verification levels. 

34. (Original) The computer program product of claim 33, wherein the verification 
setting instructions define different desired verification levels for each of the first test case, the 
second test case, the third test case, thee fourth test case, the first test group and the second test 
group. 

35. (Original) The computer program product of claim 34, wherein the first and 
second test groups are part of a third test group, the third test group including one or more 
software testing instructions organized as one or more verification levels within the verification 
hierarchy, and wherein the verification setting instructions that define the one or more desired 
verification levels for the one or more test cases also define one or more desired verification 
levels for the third test group, the method fiirther comprising acts of: 

identifying a portion of the one or more software testing instructions within the third test 
group that corresponds to the one or more desired verification levels; and 

running a portion of the third test group that corresponds to the one or more desired 
verification levels. 
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36. (Original) The computer program product of claim 35, wherein the verification 
setting instructions define a desired verification level for the third test group that is different 
from the each of the first test case, the second test case, the third test case, the fourth test case, 
the first test group and the second test group. 

37. (Original) The computer program product of claim 25, wherein at least a portion 
of at least one of the plurality of software instructions determines that software information is 
available and uses the information for troubleshooting the software when it is determined that the 
software does not ftmction as intended when executed. 

38. (Original) The method of claim 17, wherein the software information available is 
debug information. 

39. (Original) The computer program product of claim 25, wherein the portion of the 
plurality of software testing instructions that corresponds to the one or more desired verification 
levels does not produce any testing output. 

40. (Original) The computer program product of claim 25, wherein the portion of the 
plurality of software testing instructions that corresponds to the one or more desired verification 
levels produces one or more test outputs used to verify the software fimctions as intended. 

41. (New) A method as recited in claim 17, wherein the method fiirther includes an 
act of automatically detecting a development stage that the software is being tested in during the 
test and for gathering information for at least additional testing or debugging based upon the 
detected development stage. 
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